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The effects of a socially interactive robot on the conversational turns between four young chil- 
dren with autism and their mothers were investigated as part of the intervention study described 
in this research report. The interventions with each child were conducted over 4 or 5 days in the 
children’s homes where a practitioner facilitated child-robot and child-mother interactions using 
robot produced speech and movements. Results showed that the conversational turns between 
the children and their mothers increased from a nonintervention, baseline condition to the inter- 
vention phases of the study for all the children as a group and for all four children individually. 
The manner in which socially interactive robots might be incorporated into interventions with 
young children with autism and other disabilities is described. 


Young children with developmental disabilities, and 
particularly children with autism spectrum disorders, of- 
ten demonstrate problems with reciprocity, joint atten- 
tion, turn taking, and other social interaction skills (e.g., 
Charman et al., 2003; Dawson et ah, 2004; Trevarthan 
& Daniel, 2005). Difficulties or deficits in the social 
abilities of these children are often sources of delays 
or problems in communication and language develop- 
ment that warrant interventions to improve their social 
interactional functioning (e.g., Bono, Daley, & Sigman, 
2004; Christensen-Sandfort & Whinnery, 2011; Inger- 
soll, 2011). 

The purpose of the study described in this research 
report was to evaluate the effects of a socially interactive 
robot on the conversational turns between young chil- 
dren with autism and their mothers as part of interven- 
tions in the children’s homes to promote their acquisition 
of communication, language, and other socially interac- 
tive skills (Dunst, Prior, & Trivette, 2012). Popchilla, a 
chinchilla-looking social robot, was used to engage the 
children in child-robot and child-mother interactions us- 
ing programmable speech and robot arm, ear, mouth, and 
eye movements controlled by a practitioner to engage 
the children in social interactions (Interbots, 2011). The 
study was conducted as part of a line of research on the 


utility of socially interactive robots for improving the 
social-communicative competence of young children 
with autism and other developmental disabilities (Dunst, 
Prior, Hamby, & Trivette, 2013; Dunst, Trivette, Prior, 
Hamby, & Embler, 2013a, 2013b). 

The conversational turns between the children 
and their mothers were assessed in terms of the num- 
ber of vocal sounds including coos, squeals, babbles, or 
words initiated by a child with a subsequent response 
by a mother within five seconds or initiated by a mother 
and responded to by her child also within five seconds 
(LENA Foundation, 2013). Conversational turns were 
digitally recorded using the Language ENvironment 
Analysis (LENA) system for later analysis (Richards, 
Gilkerson, Paul, & Xu, 2008). LENA has been increas- 
ingly used to record and analyze the vocal production 
and conversational turns of young children with autism 
(e.g.. Cook, McCauley, & Esposito, 2013; Warren, Gilk- 
erson, & Richards, 2008; Warren et al., 2010). Findings 
from studies of children with and without autism indi- 


The study described in this paper was supported in part with funding from 
the U.S. Department of Education, Office of Special Education Programs, Step- 
pingstones of Technology Innovations Program (#H327A100052). The opinions 
expressed, however, are those of the authors and not necessarily those of the 
Department or Office. 


cate that LENA can reliably identify differences in the 
language learning environments and emergent language 
abilities of children with autism and typically developing 
children (Cook et ah, 2013; Gilkerson & Richards, 2009; 
Oiler et ah, 2010; Yoder, Oiler, Richards, Gray, & Gilk- 
erson, 2013). To the best of our knowledge, our study 
of a socially interactive robot is the first to use LENA to 
document the effects of social robots on conversational 
turns of young children with disabilities. 

METHOD 

Participants 

The participants were four children (3 males, 1 fe- 
male) with diagnoses of autism and their mothers. Table 
1 includes background information about the children. 
The children ranged in age from 36 to 59 months at the 
start of the study. Both the Developmental Observation 
Checklist Scale (Hresko, Miguel, Sherbenou, & Burton, 
1994) and the Childhood Autism Rating Scale (Schopler, 
Van Bourgondien, Wellman, & Love, 2010) were com- 
pleted on the children. The children’s developmental 
ages ranged between 15 and 43 months and their devel- 
opmental quotients (DQs) ranged between 28 and 73. 
The DQs indicate that the children had mild-moderate 
to profound developmental delays. Two of the children 
had symptoms of severe autism spectrum disorders and 
two children had symptoms of mild-to-moderate autism 
spectrum disorders (Schopler et ah, 2010). 

The children’s mothers were between 30 and 39 
years of age. Two of the mothers had completed high 
school or some schooling beyond high school, and 
two mothers had master’s degrees. Two of the mothers 
worked full time outside the home, one mother worked 
part-time outside the home, and one mother did not work 
outside the home. All the mothers were married. 

Procedure 

A multiple baseline design across children (Barlow, 
Nock, & Hersen, 2009) was used to conduct the study 


and collect the conversational turns data. The research 
design included a baseline, nonintervention condition 
and four or five intervention sessions for each child, each 
occurring on separate days. The baseline and interven- 
tion sessions each lasted between 15 and 25 minutes. 
Data from the first 15 minutes of both the baseline and 
each intervention session were the focus of analysis re- 
ported in this paper. 

The baseline condition involved conversational turn 
recordings where Popchilla was available to each child 
but where the social robot produced no speech or move- 
ments. Each of the intervention sessions involved inves- 
tigator-facilitated robot interactions using professionally 
recorded speech by a child actor together with robot arm, 
ear, mouth, and eye movements. The particular sounds, 
words, phrases, songs, rhymes, and other speech used 
during the intervention sessions are listed in Appendix A. 
The sounds and speech that were used in the study were 
selected in order to have behavior-engaging features and 
include phrases that would elicit or evoke joint attention, 
turn taking, and other socially interactive behavior (see 
Dunst, Prior et ah, 2013). 

Conversational Tnrns 

Conversational turns were defined as a “vocal sound 
such as a coo, squeal, babble, or word(s) initiated by a 
child with a subsequent response by a [mother] within 
five seconds, or vice versa. Overlapping speech seg- 
ments, coughs, cries, and other vegetative and fixed 
signals [did] not contribute to the conversational turn 
counf’ (LENA Foundation, 2013). The conversational 
turn count used as the dependent measure in the analyses 
described in this research report is a “measure of adult- 
child interactions, or more specifically of alternations be- 
tween key child segments and adult [speech] segments” 
(Warren et al., 2010, p. 560). 

Continuous recordings of conversational turns were 
made using LENA digital language processing devices 
during the baseline and intervention phases of the stud- 
ies (Xu, Yapanel, & Gray, 2009). The recorders fit into 
a small pocket of a vest worn by a child. The recorder 


Table 1 

Characteristics of the Children with Autism in the Conversational Turns Study 


Child" 

Gender 

Developmental Observation Checklist Scale 

Childhood Autism Rating Scale 

Chronological 

Age 

Developmental 

Age 

Developmental 

Quotient 

Raw 

Score 

Percentile 

Severity 

Adam 

Male 

36 

22 

61 

37 

42 

Severe 

Brad 

Male 

42 

27 

64 

36 

38 

Mild/moderate 

Chloe 

Female 

54 

15 

28 

41 

65 

Severe 

Daren 

Male 

59 

43 

73 

31 

16 

Mild/moderate 


^All of the children’s names are fictitious to protect their identities. 
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digitizes all sounds and language produced in the imme- 
diate environment and transfers the audio data to a lap- 
top computer for subsequent analysis using the LENA 
language environment software package. 

The LENA software includes speech-identification 
capabilities that permit separation of all language and 
sounds recorded during a session into adult male and 
adult female speech, target child speech, the speech 
of other children if present, noise, television or radio 
sounds, etc. from which conversational turns are ab- 
stracted. The main types of data that were collected as 
part of the study included child vocalizations and adult 
(parent) words as well as conversational turns which 
were the focus of analyses in this research report (LENA 
Foundation, 2013). 

Data Analysis 

The conversational turn data were analyzed in a 
number of ways to assess whether child-robot interac- 
tions had the effect of increasing the number of conver- 
sational turns between the children and their mothers. 
We first computed for each child the total number of 
conversational turns during the first 15 minutes of base- 
line recordings and for each of the four or five 15-minute 
blocks (days) of intervention recordings. These data were 
used to calculate group means and standard deviations in 
order to compute Cohen’s d effect sizes for baseline vs. 
intervention phase differences for all children combined. 
Second, we computed Cohen’s d effect sizes for each 
child for baseline vs. intervention phase differences to 
ascertain if the effects of child-robot interactions on con- 
versational turns were similar or different. Cohen’s d ef- 
fect sizes were computed as the differences in the mean 
scores for the baseline vs. intervention phases divided 
by the pooled standard deviation for the two conditions 
for the children as a group and for each individual child 
(Dunst & Flamby, 2012). 

RESULTS 

The average number of conversational turns during 
the baseline phase of the study was 9.50 (SD = 10.79) 
and the average number of conversational turns during 
all of the intervention sessions combined was 24.89 (SD 
= 12.81) for the children as a group. The Cohen’s d effect 
size for the between condition differences was 1.30. This 
indicates that Popchilla had a very large effect on the con- 
versational turns between the children and their mothers. 

The average number of conversational turns during 
the baseline and each of the five intervention sessions 
are shown in Figure 1. The average number of conver- 
sational turns for the five intervention sessions ranged 
between 15.75 (SD = 14.32) and 34.33 (SD = 4.51). The 


Cohen’s d effect sizes for the mean differences between 
the baseline condition and each of five intervention ses- 
sions were 0.94, 1.31, 1.87, 0.49, and 3.00 respectively. 
The effect sizes were medium to very large. The results 
indicate that the increases in conversational turns be- 
tween the children and their mothers occurred immedi- 
ately after the interventions were begun and continued to 
have positive effects for all days of intervention. 

Figure 2 shows the effect sizes for the baseline vs. 
each intervention phase of the study for the four children 
individually. The child-robot interactions had discern- 
ible effects on the conversational turns between all of 
the children and their mothers. The effects for Brad and 
Chloe were particularly pronounced during 4 of the 5 
intervention sessions as evidenced by very large effect 
sizes. The effects for Daren were medium-to-large for 2 
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SESSIONS (15-minute blocks) 


Figure 1. Average number of conversational 
turns between tbe cbildren and tbeir mothers dur- 
ing tbe baseline (B) and five intervention (I) sessions 
(days). 



CHILDREN 

Figure 2. Coben’s d effect sizes for tbe differences 
in conversational turns for tbe baseline vs. each of tbe 
five 15-minute blocks (days) of intervention. (NOTE. 
Tbe cbildren’s names are fictitious to protect tbeir 
identities.) 
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of the 5 intervention sessions and medium-to-large for 
all five intervention sessions with Adam. 

DISCUSSION 

Findings reported in this paper indicated that Pop- 
chilla had positive effects on the conversational turns 
between the children and their mothers. This was found 
in both the group and individual child data analyses. The 
results showed that the socially interactive robot was ef- 
fective in terms of improving reciprocity between the 
children and their mothers as part of the interventions 
used to improve the children’s social-communication be- 
havior. 

Young children with autism as well as children with 
other types of developmental disabilities often demon- 
strate delays or deficits in prelinguistic communication 
and social interactions (e.g., Carvajal & Iglesias, 2002; 
Trevarthan & Daniel, 2005). These delays or difficul- 
ties often manifest themselves in terms of the children’s 
joint attention, turn-taking, and other social interaction 
skills (e.g., Naber et ah, 2008; Toth, Munson, Meltzoff, 
& Dawson, 2006). One particular area in which these 
children have noteworthy problems is the conversational 
turns with others (Conti-Ramsden & Perez-Pereira, 1999; 
Mahoney & Robenalt, 1986; Stojanovik, 2006; Warren 
et al., 2010), warranting interventions to improve their 
functions. 

Studies of the conversational turns between young 
children with or without autism and their parents using 
LENA to assess child-adult interactional patterns show 
that children with autism engage in fewer vocal turn- 
taking episodes compared to typically developing chil- 
dren (Gilkerson & Richards, 2009; Warren et al., 2008; 
Warren et al., 2010). Warren et al. (2010) also found that 
LENA was sensitive in detecting the effects of therapy 
on the conversational turns of children with autism. We 
also found that LENA proved to be useful for detecting 
changes in conversational turns among young children 
with autism during intervention sessions using a socially 
interactive robot for improving child and mother vocal 
turn-taking. 

Autism by definition entails impairments in the so- 
cial interactions and language learning of children di- 
agnosed with this condition (American Psychiatric As- 
sociation, 2000). Findings from the study described in 
this research report together with findings from our study 
on the vocalization production of children with autism 
indicate that Popchilla can be a useful tool for improv- 
ing both social interaction skills and language learning 
(Dunst, Hamby, Trivette, Prior, & Derryberry, 2013). 
The use of the social robot would therefore seem war- 
ranted as one way of improving the social-communica- 
tion skills of young children with autism. 
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Appendix A 


Professionally Recorded Sounds and Speech Used in the Conversational Turns Study 


Sounds and Words" 

Phrases 

Songs and Rhymes'’ 

Ears 

All done 

ABC Song 

Eyes 

Can you do this? 

A Peanut Sat 

Foot 

Can you do this? (raises left arm) 

Do you want me to sing more? 

Great! 

Can you do this? (raises right arm) 

Down By the Bay 

Ha, ha, ha (laughing) 

Can you do this? (raises both arms) 

Hooorrrayyy 1 1 1 1 (music and dance) 

Hi 

Can you do it again? 

If You’re Happy and You Know It 

Mmmmm 

Can you give it to mommy? 

Itsy Bitsy Spider 

Mouth 

Can you give it to daddy? 

Mother Goony Bird 

Ouch 

Can you move your head? 

Old McDonald 

Songs 

Can you put the hat on? 

Twink-A-Link 

Tail 

Can you shake your arms? 

Wheels on the Bus 

Tummy 

Can you show mommy a happy face? 


Wheee...wheee! 

Dance with me 


Yay 

Do you want to play? 


Yeh, yeh 

Do you want to sing? 


Adam 

Give some to mommy/daddy 


Brad 

Give the ball to daddy 


Chloe 

Give the ball to mommy 


Daren 

Give the book to daddy 



Give the book to mommy 
Give the doggy to daddy 
Give the doggy to mommy 
Give the hat to your daddy 
Give the hat to your mommy 
Give the truek to daddy 
Give the truek to mommy 
Good bye 
How are you? 

I am happy 
I am hungry, feed me 
I don’t like that 
(If correct) Yay, you did it 
(If wrong) Try again 

I see something green, show me something green 
Let’s play 
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Appendix A, continued. 


Sounds and Words" 

Phrases Songs and Rhymes’’ 


Let’s stop for today 

Look at the block 

Look at the book 

Look at the doggy 

Look at the truck 

My name is Popchilla 

Mmmmm, yummy, I like that 

Now you try, we will follow you 

Point to 

Point to my nose 
Popchilla is getting tired 
Roll me the ball 
Roll the truck to me 
See you later 
Show daddy 
Show me the book 
Show me the doggy 
Show me where the ball is 
Show mommy 
Sing with me 
Touch my 
That was fun! 

What is your name? 

Where is my hat? 

Where is your daddy? 

Where is your mommy? 

Where is your nose 
Who is that? 

Wow, wow, wow 
You did it! 

You did it! You did it! 

You eat some 
You try 


“The children’s names listed below are fictitious to protect their identities. 

'“The lyrics for each of the songs and rhymes were part of the software used to engage the children in child-robot 
interactions. 


